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ABSTRACT 



Offering vertical services to subscribers and service provid- 
ers is an avenue to immediately improve the competitiveness 
of digital subscriber line access service, for example of the 
type offered by a local exchange carrier. To deliver high- 
quality vertical services, however, the underlying ADSL 
Data Network (ADN) or the like needs to establish Quality 
of Service (QoS) as a core characteristic and offer an 
efficient mechanism for insertion of the vertical services. 
The inventive network architecture introduces QoS into the 
ADN, in a manner that enables the delivery of sophisticated 
and demanding IP-based services to subscribers, does not 
affect existing Internet tiers of service, and is cost-effective 
in terms of initial costs, build-out, and ongoing operations. 
The architecture utilizes a switch capable of examining and 
selectively forwarding packets or frames based on higher 
layer information in the protocol stack, that is to say on 
information that is encapsulated in the layer-2 information 
utilized to define normal connectivity through the network. 
The switch enables segregation of upstream traffic by type 
and downstream aggregation of Internet traffic together with 
traffic from a local vertical services domain. By implement- 
ing a two-tier queuing structure in the downstream direction, 
traffic with a virtual circuit and traffic between the different 
virtual circuits that are destined for the same downstream 
DSLAM can be prioritized according to service type and/or 
Internet Service Provider. 

22 Claims, 9 Drawing Sheets 
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TRAFFIC QUEUEING FOR REMOTE 
TERMINAL DSLAMS 

RELATED APPLICATION 

This application is a continuation in part of U.S. patent 
application Ser. No. 09/635,695, filed Aug. 10, 2000 entitled 
"SUPPORT FOR QUALITY OF SERVICE ADN VERTI- 
CAL SERVICE IN DIGITAL SUBSCRIBER LINE 
DOMAIN" and U.S. patent application Ser. No. 09/688,213 
filed Oct. 16, 2000 entitled "CONGESTION AND 
THROUGH-PUT VISIBILITY AND ISOLATION", the dis- 
closures of which are incorporated herein entirely by refer- 
ence. 

FIELD OF THE INVENTION 

The concepts involved in the present invention relate to 
techniques for implementing data communication services, 
for example in a local access network utilizing digital 
subscriber line technology, to support quality of service 
(QoS) and local introduction of vertical services. Other 
concepts involved in the present invention relate to regulat- 
ing downstream traffic, for example, traffic going to a remote 
terminal DSLAM. 

BACKGROUND 

Modem society continues to create exponentially increas- 
ing demands for digital information and the communication 
of such information between data devices. Local area net- 
works use a network, cable or other media to link stations on 
the network for exchange of information in the form of 
packets of digital data. These networks have proven quite 
successful in providing data communications in commercial 
applications. However, the common local area network 
architectures require installation of specialized wiring and 
use of specific wiring topologies. For example, the most 
popular network protocols, such as Ethernet, require special 
rules for the wiring, for example with regard to quality of 
wire, range of transmission and termination. Furthermore, to 
extend communications to a wider domain still requires 
connection of at least one node of the local area network out 
to a wider area network, such as the network of an Internet 
Service Provider (ISP). High speed links enabling such wide 
area access from a LAN domain, for example using Tl lines, 
are quite expensive and justified only for hi-end commercial 
users. 

The most common form of computer-to-computer com- 
munication in use today, particularly for wide area 
communications, still relies on modems and analog tele- 
phone network connections. The telephone-based operation 
provides the voice grade analog modem a unique power, the 
necessary connections are virtually ubiquitous. Such 
modems can communicate via almost any telephone line or 
wireless telephone (e.g. cellular) to any other such telephone 
connection, virtually anywhere in the world. The telephone 
network, however, was designed to provide approximately 
3.3 kHz of analog voice bandwidth. Consequently, the data 
rates that are possible through the telephone network are 
quite low. Even with a variety of recent enhancements, the 
data speeds remain at or below 56 kbps. 

Integrated Services Digital Network (ISDN) offers some- 
what faster data communications and the capacity for con- 
current data and voice telephone services. The 160 kb/s 
capacity carries two bearer (B) channels, each at 64 kb/s, one 
data (D) channel at 16 kb/s and overhead information in a 16 
kb/s embedded operations channel (EOC). The two 
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B-channels may be used separately, for example for one 
voice telephone call and one data communication session. 
The D-channel typically is used for signaling, for call set-up 
and the like. Some applications allow aggregation of the 

S channels, to combine the B-channels and possibly the 
D-channel to provide data communications up to the com- 
bined rate of 144 kb/s. However, these data rates offered by 
ISDN already are too slow for many multimedia applica- 
tions. The high-speed and wide availability of modem 
personal computers (PCs) continually gives rise to ever 
more sophisticated multimedia applications. Communica- 
tions for such applications, typically between the PC and the 
Internet, already are driving the need for speed to rates far 
above those available on normal ISDN lines. 

15 A number of technologies are being developed and are in 
early stages of deployment, for providing substantially 
higher rates of data communication, for example ranging 
form 640 kb/s to 7.1 Mb/s. For example, cable television 
companies are now beginning to offer 'cable modem' 

2Q services, which allow customers to communicate data over 
available bandwidth on the coaxial cable of a cable televi- 
sion network. After considering several other options, a 
number of the local telephone carriers are working on 
enhancements to their existing copper- wire loop networks, 

25 based on various xDSL technologies. 

The term xDSL here is used as a generic term for a group 
of higher-rate digital subscriber line communication 
schemes capable of utilizing twisted pair wiring from an 
office or other terminal node of a telephone network to the 

30 subscriber premises. Examples under various stages of 
development include ADSL (Asymmetrical Digital Sub- 
scriber Line), HDSL (High data rate Digital Subscriber 
Line) and VDSL (Very high data rate Digital Subscriber 
Line). 

35 The telephone carriers originally proposed use of ADSL 
and similar high-speed technologies to implement digital 
video services, for example in networks sometimes referred 
to as video 'dialtone' networks. The ADSL line technology 
provided a mechanism for high-speed transport of MPEG 

40 encoded video information to video terminal devices in the 
customers' homes. Examples of such ADSL-based video 
dialtone networks are disclosed in U.S. Pat. Nos. 5,247,347, 
5,410,343 and 5,621,728. The carriers are now deploying a 
range of xDSL data services targeted at high-speed Internet 

45 access and high-speed access to private data networks. U.S. 
Pat. No. 5,790,548 to Sistanizadeh et al. discloses an 
example of an ADSL based data network, e.g. for high-speed 
access to the Internet and to corporate LANs. 
The current design goals of DSL data networks for 

50 Internet access do not support high-end vertical services, 
that is to say services demanding IP-based applications that 
require assurance of some level of quality of service (QoS). 
For example, packet-switched Voice over IP (VoIP) requires 
low latency, low jitter (i.e., a relatively constant bit rate), and 

ss non-correlated packet loss. Streaming video has similar 
requirements, and in addition, requires high bandwidth. DSL 
data networks designed to support high speed Internet and 
Intranet access have been optimized to support traffic that is 
bursty and is not sensitive to latency or jitter. For example, 

60 current implementations supporting ATM cell traffic employ 
the Unspecified Bit Rate (UBR) class of service, which does 
not provide any bandwidth or delay guarantees. 
Consequently, transport of video materials through such 
DS1, data networks inflicts video delays, loss of audio/video 

65 synchronization, and image fragmentation. 

Furthermore, lengthy bandwidth intensive sessions for 
video or other broadband applications may degrade the 
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throughput to all other subscribers served through a shared the voice telephone traffic. Thus each ADSL unit 113 pro- 

node, such as a gateway router or a concentrated link. For vides a connection for telephone traffic from the associated 

two-way video, upstream will have even worse quality and line 300 to the POTS switch 103. 

throughput problems, due to the best effort nature of the DSL The ADSL units 113 in the CO (ATU-Cs) essentially act 

data network implemented for Internet access and because 5 as modulator/demodulators (modems) for sending and 

the upstream bandwidth is significantly less than that of the receiving data over the subscriber telephone lines 300. On 

downstream channel. the network side, each of the ATU-Cs 113 connects to the 

To appreciate the situation and problems, it may be MUX 115. The MUX 115 multiplexes and demultiplexes the 

helpful here to consider an ADSL data implementation of a upstream and downstream data for the ADSL modems 113 

local access network, as a representative example, in some- 10 and provides a connection to a high-speed link 119. Through 

what more detail. FIG. 7 is a block diagram of a typical subtending, the MUX 115 may also provide a data concen- 

ADSL data network of the type currently in-use by a number tration for the communications over the link 119. 

of incumbent and competitive local exchange carriers to i n a typical implementation, the concentrated data com- 

provide high-speed access to Internet Service Providers munications utilize a DS-3 link 119. However, because of 

(ISPs) and thus to the Internet. FIG. 8 provides an alternative 15 increasing traffic demands, it is becoming necessary to 

functional illustration of the elements of such a network. Of upgrade the link 119 to SONET optical fiber, such as OC-3 

particular note, FIG. 8 shows the various protocol stacks in or i n some cases even OC-12. The link 119 provides 

association with the appropriate network elements. two-way data communication between the central office 100 

As shown in FIG. 7, a central office (CO) 100 provides and a data hub 121. In practice, this is a relatively long or 

plain old telephone service (POTS) and digital subscriber 20 wide area link using expensive interoffice facilities, 

line data service for a number of customers. For purposes of On the upstream side, the high-speed interoffice link 119 

discussion, assume that the equipment at each of the various terminates on an ATM switch 123 for the ADSL data 

customer premises 200 connects directly to the CO 100 via network (ADN). Although only one link 119 appears in the 

twisted pair type copper wiring 300. In an actual drawing, the asynchronous transfer mode (ATM) switch 123 

implementation, many customers may connect through such will typically service a number of DSLAMs 111 in various 

wiring to a remote terminal linked to the CO via optical fiber. end offices via similar DS or OC links. The ATM switch 123, 

At each customer premises 200 in our example, the in turn, provides a high-speed connection to a gateway 

copper loop 300 carrying both the POTS and ADSL signals router 125 coupled to an ATM cell relay network 129. 

connects through a Network Interface Device (NID) 201 3Q Typically, the ATM switch 123 will aggregate traffic from a 

placed at the side of the home. A two pair loop is installed number of such links 119 onto an OC-3 or higher rate 

from the NID to the location where the ADSL unit 203, SONET link to the router 125. The router 125 and the cell 

typically an ATU-R modem, is located in the home. One pair relay network 129 enable transport of ATM cells for the 

connects all of the signals on the line 300 from the NID 201 subscribers to and from equipment of one or more Internet 

to the ADSL modem 203. Within the ATU-R type modem 35 Service Providers (ISPs), shown by way of example as a 

203, a passive splitter/combiner type filter segregates the concentrator 131 coupled to the public packet switched 

POTS signal and the data signals. The POTS signal is network commonly known as the Internet 132. 

transmitted over the second twisted pair back to the NID The illustrated local access type ADN network provides 

201. The POTS line is then connected to the in-home wiring ATM cell transport from a customer premises 200 to the ISP 

extensions at the NID 201, for distribution to one or more 4Q concentrator 131. The ATM cells serve as the layer-2 routing 

standard telephone devices 205 in the home. or switching protocol for the lowest level definition of 

Within the ATU-R type ADSL modem 203, the down- connectivity between two points of the network. Higher 

stream coded ADSL signal is demodulated and decoded to level protocols ride within the ATM cells, 

an appropriate data interface protocol for connection to the The ATU-Rs 203 and the customer premises data cquip- 

PC 215. The PC 215 or other data device (FIG. 8) also sends 45 ment 215 connect via an Ethernet coupler. The 

data to the ADSL modem 203. The modem 203 modulates customers' equipment communicates across the ADSL data 

the upstream data and transmits appropriate signals over the network utilizing Ethernet, and the wide area communica- 

line 300,, or 300 2 , to the corresponding modem 113,, or tion involves transport of Internet protocol information 

113 2 in the CO 100 (FIG. 7). The ATU-R interface may typically in TCP/IP frames within Ethernet frames. The 

support bridging, such that multiple users can share the 50 Ethernet frames carrying the TCP/IP frames are adapted into 

ADSL modem 203. for two-way data communication ATM cells. Attention is directed to the protocol stacks 

through the CO 100. illustrated in the lower half of FIG. 8. 

The lines 300 for the customer premises 200 connect To efficiently provide cell relay, each customer is assigned 
through the main distribution frame (MDF) 101 to a Digital an ATM virtual circuit that extends from the ATU-R 203 in 
Subscriber Line Access Multiplexer (DSLAM) 111. The 55 the respective customer premises 200 to the gateway router 
DSLAM includes a bank of ADSL terminal units of the type 125. Although it was originally envisioned that ATM would 
intended for central office applications, identified as ATU-Cs support switched logical channels or virtual circuits, to date, 
113. The DSLAM also includes a multiplexer/demultiplexer sucn logical switching has proven impractical to implement 
(MUX) 115. and administer. Consequently, current practical ATM net- 
Within the DSLAM 111, each customer line 300 connects 60 works actually utilize permanent virtual circuits, not 
to an assigned ADSL terminal unit 113 in the central office switched virtual circuits. For a given subscriber, the carrier 
(ATU-C). In the example illustrated, the first customer's line therefore provisions an ATM permanent virtual circuit from 
300, connects through the MDF 101 to a first ATU-C 113, the ATU-R 203 to the gateway router 125. The carrier 
in the CO 100. The second customer's line 300 2 connects programs one or more nodes along the path of that logical 
through the MDF 101 to a second ATU-C 113 2 in the CO 65 circuit, particularly the DSLAM 111, to regulate traffic on 
100. The ATU-C type ADSL units 113 include appropriate the virtual circuit to the upstream and downstream rates 
frequency dependent combiner/splitters, for segregating out corresponding to the grade of service to which the particular 
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customer subscribers. All data traffic for the subscriber goes 
over the entire length of the permanent virtual circuit, and 
most if not all nodes along that path limit that traffic to the 
rates of the subscription as defined in the provisioning data. 

The virtual circuit may be thought of as a solid pipe. All 5 
traffic passes through the entire length of the pipe-like virtual 
circuit, regardless of how many switches or other nodes the 
circuit passes through. The layer-2 protocol defining the 
circuit carries all of the higher level traffic end-to-end. 
Higher layer protocols are visible only at the ends of the 10 
pipe. Hence, any traffic flow processing intended to utilize 
the higher layers must occur at some point past one end or 
the other end of the virtual circuit. 

The gateway router 125 also terminates permanent virtual 
circuits through the cell relay network 129 going to/from the 15 
ISP concentrators 131. The gateway router 125 aggregates 
traffic between a number of subscribers and each respective 
ISP. The ISP equipment 131 typically implements a varia- 
tion of a point-to-point protocol (PPP) specifically adapted 
to ride over Ethernet, referred to as "PPP over Ethernet" 20 
(PPPoE). The virtual circuits to the ISPs, however, do not 
have sufficient capacity to simultaneously carry all sub- 
scriber traffic at the maximum rates of the customers' 
subscriptions. The MUX 115, the ATM switch 123, and the 
gateway router 125 concentrate and regulate the subscriber 25 
traffic going to and from the ISPs, typically on some type of 
"best efforts" basis. 

In a typical Internet access service offering, the most 
expensive service tier provides 7.1 Mbps for downstream 3Q 
communication and 680 kbps for upstream communication. 
The next grade of service provides 1.6 Mbps for downstream 
communication and 90 kbps for upstream communication, 
whereas the lowest tier of service provides 640 kbps for 
downstream communication and 90 kbps for upstream com- 35 
munication. The maximum grade of service offered to an 
individual subscriber depends on the rates for which the 
subscriber's line can qualify, although the subscriber may 
opt for a lower rate service since the higher-rate service is 
more expensive. 40 

The approach outlined above relative to FIGS. 7 and 8 
works well for Internet access if the traffic relates to web 
access, file transfers and the like, which do not require 
guaranteed quality of service. Various segments of the 
Internet industry, however, are rapidly developing new mul- 45 
timedia services and applications that already are pushing 
the capabilities of such a network. For example, 
increasingly, Internet traffic includes a number of types of 
communication that require a guaranteed quality of service. 
Voice telephone communication over IP is extremely sensi- 50 
tive to latency and jitter. The permanent virtual circuits 
provide an unspecified bit rate (UBR) service and do not 
guarantee any minimal amount of delay or jitter. Also, 
because the rates are set by subscription, the service tends to 
be relatively inflexible. Some services, such as multicasting 55 
of broadband information from the Internet into the local 
access ADN for a large number of concurrent users, can 
quickly overload one or more nodes or critical links of the 
network, for example the link 119 between the DSLAM 111 
and the ATM switch 123 at the hub 121. 60 

Most industry experts propose to increase the services 
available via the public Internet. However, because the 
higher layer protocols are visible only on the Internet side of 
the virtual circuit "pipe," these services all must be imple- 
mented out past the end of the virtual circuit, at least behind 65 
the gateway router 129 and most likely in the public 
network, where it is possible to view and route based on 
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higher level protocols, particularly Internet protocol (IP). 
Such a migration strategy to implement new services creates 
severe problems. For example, in the network of FIG. 7, if 
a customer at premises 200, desired to order a video on 
demand, the customer would'communicate via the assigned 
permanent virtual circuit and the ISP to a server on the 
Internet 132. The server would send the video stream back 
through the Internet 132, the ISP equipment 131, the cell 
relay network 129 and the virtual circuit from the router 125 
to the XTU-R 203 for handoff to a PC or the like at 215. If 
the rate of the requested video exceeds the customer's 
subscription rate, the customer could not view the video in 
real time during the download. Even if the rate of the 
requested video is below the customer's subscription rate, 
loading in the Internet or the local access network may 
impose delays and/or jitter in communication of some 
segments of the requested video. Assuming that the hub 121 
and the links 119 implement a subscriber concentration, 
ordering of videos or similar broadband files from the 
Internet 132 quickly consumes the shared resources through 
the hub 121 and the links 119, reducing the rates of service 
provided to other customers seeking concurrent Internet 
access. 

It might be possible to increase the capacity of the links 
119 and/or the hubs 121; however, this tends to increase the 
carrier's recurring costs and often makes the overall service 
(s) of the ADN network economically impractical. 

It has also been suggested to provide customers guaran- 
teed quality of services for some portion of their 
communications, by segregating the traffic carried between 
the customer premises and the hub 121. This would require 
assigning a plurality of ATM permanent virtual circuits to 
each subscriber, one for each different guaranteed level of 
quality of service and one for all other Internet traffic for the 
subscriber. Administration and provisioning of one virtual 
circuit per subscriber is already complicated, and the number 
of virtual circuits through any given ATM node is limited by 
current equipment designs. Expanding the number of per- 
manent virtual circuits per subscriber to support multiple 
QoS tiers of service therefore would be quite expensive, and 
the management thereof would become a nightmare. To 
support an increased number of virtual circuits, many having 
guaranteed QoS requiring some substantial minimum rate at 
all times, would also require that the operator substantially 
upgrade the network to increase the end-to-end capacity all 
the way to the wide area network 132. 

Furthermore, to actually receive the desired QoS requires 
that all elements involved in the communication must guar- 
antee the desired level or quality of service. For communi- 
cations across the public Internet 132, this means that 
various nodes and links on the public Internet must be 
available and capable of providing a guarantee of the desired 
QoS. In point of fact, few nodes on the public Internet 
actually support any type of QoS. Hence, even if the ADN 
supported a desired QoS, most subscribers would not benefit 
from that service because their communications over the 
public Internet would have no QoS guarantee, and would 
suffer from the usual problems of latency and jitter. 

Consequently, current deployments of ADSL-based data 
networks, such as shown in FIGS. 7 and 8 generate many 
customer complaints. From the customer perspective, the 
service does not deliver the data rates that the customer pays 
for on a consistent basis. The customer typically blames 
such problems on network equipment failure. In fact, most 
of the problems already are due to virtual circuit congestion 
problems, of the kinds outlined above. Essentially, the ADN 
network is crippled by the unpredictable nature of the 
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service levels that the customers perceive due to congestion 
on the ADN and on the public Internet. 

Another area of problems is that the ADN does not offer 
the carrier any technique for offering its own differentiated 
service applications. To compete with other service 
providers, the carrier operating the ADSl^based data net- 
work needs to introduce its own multimedia services, for 
example, its own video services to compete with video 
services of cable television companies (that offer competing 
Internet access services). As noted above, however, intro- 
duction of a new service, such as true video on demand or 
broadcast video requires communications via the public 
Internet 132. This is true even if the carrier operating the 
network of FIGS. 7 and 8 wanted to initiate its own video 
service(s). 

Some arrangements of equipment for providing xDSL 
connectivity to subscribers use a remote terminal DSLAM 
(RTDSLAM) located between the central office DSLAM 
and the subscribers' ATU-R. In such an environment, down- 
stream congestion can occur at the RTDSLAM resulting in 
downstream cells being unexpectedly dropped. A compre- 
hensive approach to improving the ADN service should also 
provide a method of prioritizing downstream data so that 
downstream high-priority cells through an overburdened 
RTDSLAM are not dropped while lower priority cells 
continue to be delivered. 

Hence, there is an ongoing need to improve the architec- 
ture and operation of a digital subscriber line data commu- 
nication network, particularly to facilitate finer gradation of 
services within the local network. The need, first, is for such 
a local network to support introduction of services on a 
* vertical* basis within the local access network separate and 
apart from the common forms of Internet traffic, both for 
commercial differentiation and for increased security. In a 
related need, the local network needs to support a number of 
different levels of quality of service (QoS). Any enhance- 
ment to the network should also fulfill the need to shape 
downstream traffic through an RTDSLAM and provide for 
different tiers of service for subscribers. 

SUMMARY OF THE INVENTION 

A general objective of the invention is to implement an 
enhanced digital communication network for subscriber 
lines that supports vertical introduction of new communi- 
cation and/or multimedia services. 

A further objective is to support multiple levels or grades 
of quality of service within the access network. 

Another objective of the invention relates to improvement 
of the cost effectiveness of the data network, for example, by 
reducing the demand for high-capacity interoffice links 
while increasing the bandwidth available at the network 
edge for at least some types of services. 

A related objective is to provide a technique for introduc- 
tion of new high-end services near the network edge, from 
a domain that is more secure and therefore less subject to 
hacker attacks. 

A further objective of the invention is to support QoS 
and/or local introduction of vertical services, without the 
need to assign multiple virtual circuits or the like to each 
subscriber. 

A further objective of the preferred embodiment is to 
support different priority levels of downstream traffic within 
a permanent virtual circuit (PVC). 

An additional objective of the preferred embodiment is to 
support different tiers of downstream service among differ- 
ent PVCs. 
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A further objective of the preferred embodiment is to 
shape traffic to an RTDSLAM so that cells are not dropped 
in a first-come, first-served manner at the RTDSLAM. 
Aspects of the invention relate to unique methods and 

s network architectures for providing a combination of wide 
area internetwork service and vertical communication ser- 
vices via a local access network. Other aspects of the 
invention relate to a particular switch developed to facilitate 
a unique form of routing, for example to support of QoS and 

10 vertical service insertion. 

The preferred embodiments alleviate the above noted 
problems by providing an intermediate node, typically an 
enhanced switch, to segregate upstream traffic based on 
analysis of the type of communication. This analysis utilizes 

15 protocol information contained in each communication, for 
a protocol higher than the switching protocol, that is to say 
higher than a protocol used to define the customer's logical 
circuit. In an implementation utilizing ATM, for example, 
the logical circuit is a virtual circuit, and the node examines 

20 the protocol information for layers above the ATM layer. 
One type of traffic remains on the virtual circuit, whereas 
other traffic is handed off to a vertical services domain. The 
node also provides a point to aggregate traffic from the from 
the vertical services domain with other traffic on the sub- 

25 scriber's logical circuit, for transport to the customer pre- 
mises equipment. 

To this end, the preferred embodiments use an ATM 
switch having routing/processing capabilities at the higher 

30 layer, for example at the layer-3 protocol or above, in close 
proximity to a DLSAM. The links between the DSLAM and 
this switch can be of any desired high capacity because they 
are short and therefore relatively low in cost. Consequently, 
the DSLAM and the new ATM switch can support relatively 

35 high bandwidth from that node to the customer premises. To 
utilize the increased bandwidth and support new services, 
the modems on the opposite ends of the digital subscriber 
line negotiate and operate at the maximum rate that the line 
conditions will permit. 

40 The ATM switch essentially subdivides the traffic asso- 
ciated with each subscriber line. One branch goes to a 
gateway router and hence to one or more ISP(s) at the rate 
corresponding to the Internet access subscription. It may be 
helpful to consider this as long distance or wide area traffic 

45 for the subscriber. The other branch is for local traffic, to and 
from the locally connected vertical services domain. The 
interconnection to the ISP domain supports QoS in the 
downstream direction. Also, the interconnection to the ver- 
tical services domain supports QoS and introduction of 

50 vertical services not easily provided from the public Internet, 
such as video on demand, multicasting, and voice over IP. 
The vertical services domain is relatively secure since it is 
not accessible from the public Internet. 

In operation, the access network will still support a logical 

55 circuit in the form of a virtual circuit to the gateway router 
for each customer, for example in the form of an ATM 
permanent virtual circuit. That circuit is provisioned for the 
subscriber's desired grade or quality of Internet access 
service. The subscriber line, however, supports at least the 

60 same and often a higher rate service, for example via 
rate-adaptive ADSL communication over a twisted wire line. 
In the upstream direction, the ATM switch examines at least 
one aspect of each data transmission relating to a logically 
higher level of protocol, e.g. in a layer 2 protocol encapsu- 

65 la ted in ATM, or at layer 3, layer 4, or higher. From the 
higher level information, the switch determines the type of 
transmission and segregates the upstream transmissions on 
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the subscriber's virtual circuit. One type of transmission 
continues on the virtual circuit, e.g. for Internet transport. 
Any and all other types, however, go to the vertical services 
domain. In the downstream direction, the ATM switch 
aggregates any communicatioas coming from the vertical 5 
services domain together with downstream transmissions on 
the virtual circuit from the Internet. 

The vertical services domain also represents a communi- 
cation network. The vertical services domain, however, 
preferably takes the form of a data network optimized for 1Q 
local transport of vertically injected services, that is to say 
local data traffic. In view of its local nature, it is easier and 
more cost effective to provide high bandwidth services. The 
vertical services network, for example, could take the form 
of a giga-bit Ethernet type local area network. Also, it is JS 
easier to adapt the vertical services network to support 
service level agreements with customers with regard to 
quality of service. In many cases, it actually is sufficient to 
support QoS on the one hop through the ATM switch, itself. 

To support the QoS requirements, a feature of the pre- 20 
ferred embodiments involves certain queuing and tagging 
operations within the ATM switch. Essentially, the switch 
will maintain two or more queues for each permanent virtual 
circuit. The switch distinguishes the queues based on impor- 
tance. As the switch receives cell transmissions for transport 25 
over the virtual circuit to the customer premises, the switch 
will internally tag each cell as to its importance level and 
place the cell in the appropriate queue. An access control list 
(ACL) is used to control servicing of the multiple queues for 
each PVC in order to transmit cells to a second tier queue. 30 
The particular ACL is selected to implement QoS in con- 
formance with the subscriber's service level agreement with 
the carrier and/or agreements between the carrier and the 
vertical services and internet services providers. The second 
tier queue can then be serviced in accordance with down- 35 
stream facility capacities. 

Within the one virtual circuit assigned to the individual 
subscriber, the invention provides multiple tiers of service, 
preferably with multiple levels of QoS. Also, at different 
sections along the virtual circuit "pipe" the network pro- 40 
vides different levels of rate shaping. All layers and all 
services are available at the home, but different services 
receive different treatments in the network conforming to the 
different levels of QoS. The inventive approach, however, 
does not require each subscriber to have multiple virtual 45 
circuits. 

Services provided on the vertical services domain appear 
as IP data services. Virtually any communication service 
may utilize the vertical services network and through it to 
gain access to the carrier's local customer base, simply by 50 
providing an IP interface for coupling to the vertical services 
network. For example, it is a simple matter to connect any 
digital source of broadcast audio or video information, such 
as a direct satellite broadcast receiver system similar to those 
used today in residential applications, through an IP inter- 55 
face. Such a broadcast source and interface can provide the 
full range of received video services, over the vertical 
services network. The access data network may distribute 
the video programming to a number of access switches 
within a local geographic area. The switch provides an 60 
optimum point for frame or cell replication for multicasting 
services. Hence, in our video example, the switch replicates 
and distributes frames for the broadcast service over the 
digital subscriber line circuits to customers desiring to view 
the programming. 65 

A computer readable medium, as used herein, may be any 
physical element or carrier wave, which can bear instruc- 
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tions or code for performing a sequence of steps in a 
machine-readable readable form. Examples of physical 
forms of such media include floppy disks, flexible disks, 
hard disks, magnetic tape, any other magnetic media, a 
CD-ROM, any other optical media, a RAM, a ROM, a 
PROM, an EPROM, a FLASH-EPROM, any other memory 
chip or cartridge, as well as media bearing software in a 
scannable format. A carrier wave type of medium is any type 
of signal that may carry digital information representative of 
the instructions or code performing the sequence of steps. 
Such a carrier wave may be received via a wireline or 
fiber-optic network, via a modem, or as a radio-frequency or 
infrared signal, or any other type of signal which a computer 
or the like may receive and decode. 

Additional objects, advantages and novel features of the 
invention will be set forth in part in the description which 
follows, and in part will become apparent to those skilled in 
the art upon examination of the following and the accom- 
panying drawings or may be learned by practice of the 
invention. The objects and advantages of the invention may 
be realized and attained by means of the instrumentalities 
and combinations particularly pointed out in the appended 
claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The drawing figures depict preferred embodiments of the 
present invention by way of example, not by way of limi- 
tations. In the figures, like reference numerals refer to the 
same or similar elements. 

FIG. 1 is a functional block diagram of a digital subscriber 
line data network supporting enhanced services in accord 
with the inventive concepts. 

FIG. 2 is a slightly modified functional block diagram of 
network of FIG. 1, illustrating the protocol stacks used in the 
various network elements. 

FIG. 3 is a functional block diagram of the network 
showing the service level agreements (SLAS) for which the 
network provides appropriate QoS. 

FIG. 4 is a logical diagram of the functional elements of 
an L3/4 switch, for use in the inventive network of FIGS. 
1-3. 

FIG. 5 is block diagram of a portion of the network, useful 
in illustrating the location and function of a remote terminal 
DSLAM. 

FIG. 6 A is a block diagram of a portion of the network of 
FIG. 5, showing a two-tier queue structure in a vertical 
services switch. 

FIG. 6B is a logical view of the different permanent 
virtual circuits switched through the vertical services switch 
of FIG. 6A. 

FIG. 7 a block diagram of a prior art asymmetrical digital 
subscriber line data network. 

FIG. 8 is a slightly modified functional block diagram of 
the prior art network illustrating the protocol stacks used in 
the various network elements, 

DETAILED DESCRIPTION OF THE 
PRESENTLY PREFERRED EMBODIMENTS 

The inventive network architecture introduces QoS into 
the ADN, in a manner that enables the delivery of sophis- 
ticated and demanding IP-based services to subscribers. The 
architecture does not affect existing Internet tiers of service 
such that the promised rates for such access appear the same 
as offered today. Also, the new architecture is cost-effective 
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in terms of initial costs, build-out, and ongoing operations. functional illustration of the elements of such a network. Of 

The architecture utilizes an access switch or router capable particular note, FIG. 2 shows the various protocol stacks 

of examining and selectively forwarding packets based on a associated with the appropriate network elements that utilize 

relatively higher layer of the protocol stack, that is to say those stacks. The end-user may be a single PC user or a 

based on information encapsulated within the layer-2 infor- 5 small business or a residential LAN user. The data equip- 

mation utilized as the lowest level definition of connectivity ment of such users typically includes servers and PCs and 

through the network. The access switch enables segregation may include a variety of other devices, such as fax machines, 

of upstream traffic by communication type and downstream televisions, recorders and remote controlled appliances, hav- 

aggregation of wide area traffic together with traffic from a ing data communication capabilities, 

local vertical services domain. 10 The customer access link comprises an xDSL twisted pair, 

In accord with the invention, the access switch examines although those skilled in the art will recognize that the 

the higher- level protocol information in the upstream com- invention is readily adaptable to networks using other types 

munications to segregate traffic into two or more streams of links to the subscriber premises. In the illustrated 

based on traffic type. A logical circuit provisioned for the embodiment, the network 10 supports ADSL, which the 

subscriber extends from the customer premises through the 15 carrier may offer in grades supporting 640 kbps, 1.6 Mbps 

switch to a node providing service to the packet switched or 7.1 Mbps (downstream) rates for Internet access. The 

network, typically on the Internet. The provisioning of this actual communications over the DSL loops, however, run 

circuit defines a contiguous connectivity for the logical adaptively at the maximum rates that the line conditions 

circuit, in the layer-2 protocol utilized by the network. allow. 

Higher level protocols ride within this particular layer-2 20 The ADSL-based local access data network or "ADN" 10 

protocol, including some protocols that are often considered provides access to two different network domains for com- 

themselves to be layer-2 protocols. munication services. The two network domains are logically 

The analysis of upstream packets to determine higher- separate. In most implementations, the first domain may be 

level type enables segregation of the upstream traffic into considered as a long distance or wide area domain, whereas 

two or more upstream flows. For example, this allows the 25 the second domain is a local network domain. In the 

switch in the preferred embodiment to keep traffic bound for illustrated example, the ADN 10 provides access to a first 

the packet switched internetwork on the logical circuit but domain in the form of a wide area internetwork, such as the 

route all other traffic onto another network, in this case a public Internet, corporate local area networks (LANs), and 

local network for vertical services. In the preferred the like, represented by the network cloud 11 for the ISPs, 

embodiment, from the access switch or router to the packet 30 The high speeds available through the local network 10 

switched network, the provisioning for the logical circuit enable a wide range of communications, for example, of text 

limits the rate(s) of communication to those defined by the data, of video data, for multimedia, for web browsing, of 

grade of service to which the customer subscribes. From the transfers of files, for database searching, and the like via the 

customer premises to the switch, however, the communica- network(s) 11. 

tions run at the optimum rates that the facilities can physi- in accord with the invention, the ADSL-based local 

cally support, e.g. the maximum rates that the ADSL access network 10 also offers access to a wide variety of 

modems or the like can adaptively establish for the particu- other IP-based services through a local data network 13 

lar subscriber's line. serving as the vertical services domain (VSD). The vertical 

In the downstream direction, the switch aggregates traffic 40 services typically are high-end services requiring certain 

for each subscriber. The switch receives the rate-limited QoS levels and often having a certain local characteristic, 

traffic from the packet switched network, on the subscriber's Examples of the vertical services are discussed in more 

logical circuit. The switch also receives any downstream detail later. 

traffic intended for the subscriber, from the vertical services The vertical services network offers an efficient domain 
network. The switch combines this traffic and sends the 45 from which the carrier can locally inject high -end services 
combined communications downstream over the subscrib- and/or services of other local providers. Because the vertical 
er's logical circuit to the customer premises, at the optimum services domain is separate from the public Internet, equip- 
downstream rate that the subscriber's facilities can support. ment providing the vertical services is subject to attacks 

In combining the traffic, within a virtual circuit, from the directly from the public Internet, 

vertical services network and the packet switched network, 50 As shown in FIGS. 1 and 2, a central office (CO) 15 

a two-tier queuing operation can be utilized to prioritize the comprises one or more DSLAMs 17 and L3/4 ATM switch 

downstream traffic. The cells in each traffic stream can be 19. Elements of the CO 15 providing plain old telephone 

examined at a layer above the data link layer to determine service (POTS) have been omitted for simplicity of 

what type of application (e.g., voice, video, data, etc.) is illustration, since they are generally similar to those shown 
associated with each cell. Using this information the cells 55 in FIG. 7. 

can be prioritized into a first set of queues for each virtual The switch 19 is designated as an "L3/4" switch here as 

circuit. Subsequently, using a rule-set or access control list a matter of convenience, to illustrate that the switch 19 has 

(AtL), The switch can service the sets of queues for the me capability to make selective packet forwarding decisions 

various virtual circuits to populate a second tier queue set based on protocol information at some level that is above the 
according to relative priorities between the different virtual 60 L2 level that the switch normally utilizes to define or 

circuits. Accordingly, the data exiting the second tier queue establish logical circuit connectivity. It will be recognized, 

set is prioritized within each virtual circuit and between the however, that some of the protocols, although higher than 

different virtual circuits. the ATM type level 2 protocol used by the preferred switch 

FIG. 1 provides a high-level functional illustration of an are themselves often thought of as level 2 protocols even 
exemplary digital subscriber line network, specifically an 65 though they are above or encapsulated in the ATM type level 

ADSL data network 10, implementing the various concepts 2 information. Also, decisions as to the selective forwarding 

of the present invention. FIG. 2 provides an alternative may be made in response to monitoring of any level of the 
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protocol stack above the L2 level that the switch normally 
utilizes to define or establish logical circuit connectivity, for 
example from any level above ATM all the way up to the L7 
application layer. 

Returning to the discussion of FIGS, 1 and 2, for purposes 
of this discussion, assume that the equipment at the various 
customer premises connect directly to the CO 15 via twisted 
pair type copper wiring 21. In an actual implementation, 
many customers may connect through such wiring to a 
remote terminal linked to the CO 15 via optical fiber. Other 
hardwired, optical or wireless implementations of the digital 
subscriber lines are discussed later. In the illustrated 
embodiment, each line 21 from a customer premises con- 
nects to an ATU-C within one of the DSLAMs 17. 

On the customer premises side, the digital subscriber line 
circuit 21 connects to an ADSL terminal unit (remote) or 
ATU-R 23. The ATU-R 23 is a modulator/demodulator 
(modem) for communicating over a twisted wire pair type 
line 21, in accord with the ADSL protocols. The ATU-R in 
turn connects to customer premises equipment, shown by 
way of example as a PC 25 at each location (FIGS. 1 and 2). 
Those skilled in the art will recognize that the customer 
premises equipment 25 may include a wide range of other 
types of devices having data communications capabilities 
(see e.g., FIG. 3). 

The ADSL user's normal telephone equipment (not 
shown) also connects to the line 21, either directly or 
through a frequency combiner/splitter, which often is incor- 
porated in the ATU-R. The normal telephone signals are split 
off at both ends of the line and processed in the normal 
manner. 

For digital data communication purposes, the ATU-C and 
ATU-R modem units create at least two logical channels in 
the frequency spectrum above that used for the normal 
telephone traffic. One of these channels is a medium speed 
duplex channel; the other is a high-speed downstream only 
channel. Such modems may implement either one of two 
techniques for dividing the usable bandwidth of the tele- 
phone line to provide these channels. One approach is to 
divide the usable bandwidth of a twisted wire pair telephone 
line by frequency, that is to say by Frequency Division 
Multiplexing (FDM). The other approach uses Echo Can- 
cellation. FDM uses one frequency band for upstream data 
and another frequency band for downstream data. The 
downstream path is then divided by time division multiplex- 
ing signals into one or more high-speed channels and one or 
more low speed channels. The upstream path also may be 
time-division multiplexed into corresponding low speed 
channels. With echo Cancellation, the upstream band and 
downstream band substantially over-lap. The modems sepa- 
rate the upstream and downstream signals by means of local 
echo cancellors, in a manner similar to that used in V.32 and 
V.34 modems. 

The DSL modems may use a number of different modu- 
lation techniques to physically transport digital data streams. 
A number of implementations of the modems have used 
carrierless amplitude phase (CAP) modulation. Most current 
xDSL modems, however, utilize a discrete multi-tone 
(DMT) approach. 

Returning to the discussion of the CO 11, the structure and 
operation of each DSLAM 17 is essentially the same as 
those of the DSLAM 111 in the embodiment of FIG. 7, 
except that the control functionality of the DSLAM 17 is 
somewhat different. The DSLAM 17 controls the ATU-Cs to 
implement a rate-adaptive ADSL service, to adapt opera- 
tions so as to maximize data rates for the communications 
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over the individual subscriber lines. Essentially, the ATU-Cs 
and ATU-Rs signal each other over the lines to synchronize 
their modes of operation at parameter settings, which 
achieve optimum data throughput. Also, the DSLAM 17 

5 does not need to monitor or limit the line rates, but instead 
relies on the rate-adaptive control algorithm to maximize the 
rates achieved over the ADSL circuits or provide rate- 
shaping for the ATM virtual circuits. Other network ele- 
ments limit rates, where necessary. 

10 The L3/4 ATM switch 19 is co-located with the DSLAMs 
17, within one central office 15. As a result, it is practical to 
connect the multiplexer within each of the DSLAMs 17 over 
a high-speed data link directly to an appropriate port of the 
ATM switch 19. Because these links are short, there is little 

15 or no cost imposed when implementing such links using 
wideband equipment. By itself, the co-location of the L3/4 
ATM switch 19 with the DSLAM(s) 17 does not increase 
bandwidth. Rather, it makes increased bandwidth at the 
network edge economically feasible, due to proximity. 

20 Co-location removes the requirement to purchase expensive 
wide area transport (the SONET ring) to increase bandwidth. 
In particular, the direct OC3/OC12 connections between the 
DSLAM 17 and the L3/4 ATM switch 19 do not incur any 
recurring tariff expenses. 

25 The ATM switch 19 connects through a SONET ring 27 
to a gateway router 29 providing ATM transport through a 
cell relay network 30 (FIG. 2) to the ISPs shown at network 
11 in the drawings. Most of the ISPs will utilize a concen- 
trator or other equipment as their point of presence for 

30 Internet access (FIG. 2). In the preferred embodiment, the 
equipment 31 provides a point-to-point protocol (PPP) inter- 
face designed for transport over Ethernet (PPPoE). The ATM 
switch 19 also provides a connection to the local implemen- 
tation of the VSD network 13, for example via a giga-bit 

35 Ethernet port to a switch or other local network elements 18. 
The illustrated local access type ADN network 10 pro- 
vides ATM cell transport from the customer premises to the 
ISP network(s) 11. The ATM cells serve as the layer-2 

AQ protocol for defining contiguous switched connectivity. 
Higher level routing protocols, such as Ethernet and TCP/IP 
frames, ride within the ATM cells. Services of different types 
utilize different protocols at one or more layers above the 
ATM cell layer. In the preferred embodiments, all commu- 

45 nications utilize Ethernet. However, communications to and 
from the ISPs use the noted PPPoE type Ethernet protocol. 
In contrast, communications to and from the vertical ser- 
vices domain use one or more of the other Ethertype 
protocols. 

50 To efficiently provide cell relay, each customer is assigned 
a virtual circuit that extends from the ATU-R 23 in the 
respective customer premises to the gateway router 29. This 
logical circuit is defined at the layer-2 protocol level. The 
present implementations implement this logical communi- 

55 cation circuit as an ATM permanent virtual circuit, although 
the inventive concepts may apply to other types of logical 
circuits or channels. 

The gateway router 29 is the communication node of the 
access network 10 providing access to the wide area IP 

60 packet networks, of corporations or more often of Internet 
Service providers. The gateway router 29 terminates perma- 
nent virtual circuits through the cell relay network 30, from 
the equipment 31 of each such wide area packet network 
provider 11. The gateway router 29 also terminates the 

65 permanent virtual circuits from the subscribers through the 
data network 10. For communication with a selected ISP 
network 11, for example, the gateway router 29 routes cells 
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from the permanent virtual circuit from the subscriber 
through to the permanent virtual circuit of the selected ISP 
network 11. In the opposite direction, the gateway router 29 
routes cells from the permanent virtual circuit from the 
selected ISP network 11 through to the permanent virtual 
circuit of the particular subscriber. 

For the leg of the subscriber's logical circuit, extending 
from the L3/4 ATM switch 19 through the gateway router 
29, the carrier programs one or more nodes along the path 
behind the DSLAMs 17, to regulate traffic on the virtual 
circuit to the rate corresponding to the grade of Internet 
access service to which the particular customer subscribes. 
In' the preferred embodiment, at least one such node per- 
forming this rate shaping function is the L3/4 ATM switch 
19. All traffic going to and from the ISP networks) 11 
therefore is still limited to the rates defined in the service 
level agreement (SLA) for Internet access that the carrier has 
with the particular customer. 

The portion of the virtual circuit extending between the 
ATM switch 19 and the ATU-R 23, however, is not rate 
limited but instead ruas at the maximum rate that the line 
will support using the rate -adaptive ADSL modem opera- 
tion. In most cases, the rate- adaptive ADSL modem opera- 
tion will support rates substantially higher than the subscrip- 
tion rate for Internet access service. 

The L3/4 ATM switch 19 also provides the interconnec- 
tion to the subscriber's virtual circuit for insertion of down- 
stream traffic from the vertical services domain 13 and 
separation of upstream traffic from the subscriber's virtual 
circuit going to the vertical services domain 13. In accord 
with the invention, decisions as to whether upstream traffic 
is destined for the vertical services domain 13 or should 
remain on the subscriber's virtual circuit going through the 
gateway router 29 and the cell relay network 30 to the ISPs 
11 is based on an analysis of traffic type. The traffic type 
analysis relies on protocol information contained in the 
communications, which relates to layers of the protocol 
stack that are higher than the layer-2 switching protocol, in 
this case above the ATM layer. 

As shown in FIG. 2, traffic destined for an ISP 11 utilizes 
a variation of a point to point protocol (PPP) intended to run 
on top of Ethernet, referred to as PPP over Ethernet or 
"PPPoE." A Hype' indicator contained within the Ethernet 
frames identifies the PPPoE protocol. In contrast, traffic 
going to and from the vertical services domain utilizes other 
'types' of Ethernet protocol. All traffic to and from the 
customer premises uses Ethernet frames carried within ATM 
cells. 

The switch 19 therefore routes a subscriber's traffic going 
to and from an ISP 11, upon detection of the PPPoE indicator 
in the level 3 data contained within the Ethernet cells. This 
traffic will also utilize public IP addressing. In contrast, the 
ATM switch 19 routes a subscriber's traffic going to and 
from the vertical services domain, upon detection of any 
other type of Ethernet protocol at level 3 or above in the 
protocol stack. The IP addressing in the vertical services 
domain 13 utilizes private-IP addresses, for example, as 
administered with a DHCP server (not shown) coupled to the 
network cloud 33. Although shown separately, the cloud 33 
may be implemented as a portion of the network providing 
the physical elements of the vertical services domain. The 
portion 33, however, would typically be a logically separate 
domain that the carrier controls and restricts for its own 
network administration use. 

FIG. 3 depicts the logical division of the subscriber's 
traffic, as implemented at the ATM switch 19 in accord with 
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the invention. As shown, the network 10 provides a logical 
"pipe" or circuit 35 extending to the networks 11 of one or 
more of the ISPs, for an Internet access application. The 
ATM switch 19 (FIG. 1) preferably performs a rate shaping 

s or control function. The leg 35 of the subscriber's traffic 
extending to the ISP 11 provides upstream and downstream 
communication rates conforming to a service level agree- 
ment (SLA) applicable to the subscriber's Internet access 
application. As such, the communications over the subscrib- 

3Q er's logical circuit, extending from the switch to the ISP, 
provide a first level of QoS. To the subscriber, service over 
the leg 35 appears the same as a subscriber selected grade of 
Internet access service as provided by older ADN architec- 
tures. FIG. 3 illustrates chat rooms, web surfing and e-mail 
as examples of services an ISP might offer through the 

15 Internet Application SLA circuit 35 and the attendant portion 
of the subscriber's assigned logical circuit through the 
access network. 

The network 10 also supports communications over one 
or more logical application paths 36 to local applications 37 

20 hosted in the vertical services domain. Assuming that a 
subscriber with various equipment 25 also subscribes or 
otherwise participates in one or more of the vertical services, 
the local carrier (e.g. Bell Atlantic in FIG. 3) offers a 
corresponding number of additional application SLAs with 

25 the customer. Each SLA for a vertical service may specify 
QoS parameters for the particular application, such as rate/ 
bandwidth, latency, jitter, packet loss, packet sequence, 
security and/or availability. Examples of such applications 
hosted in the carrier's vertical services domain 37 include 

30 the illustrated voice over IP service shown as a V/IP 
gateway, as well as video services and some caching for high 
volume local web services. Communications for such appli- 
cations utilize the one or more paths 36. 

The network of FIGS. 1 to 3 also supports closed or 

35 private user work groups or virtual local area networks 
(VLANs). VLANs, for example, may be implemented as a 
service hosted through the vertical services network 13. All 
traffic from customer premises belonging to one of the 
VLANs would include a VLAN Ethertype indicator. Since 

40 the frames would not be PPPoE type Ethernet frames, the 
switch 19 would route the upstream transmission to the 
vertical services network 13. VLAN frames also carry a 
VLAN identifier The nodes of the network 13 transport the 
packets for the VLAN members only to resources that are 

45 members of the identified VLAN. In this manner, the 
capability exists for creating logical workgroups of users 
and their shared resources (servers, printers, etc.), that may 
be physically separated from each other. VLAN groupings 
can provide privacy and security to their members while 

50 enabling "broadcast domains" whereby broadcast traffic is 
kept logically "inside" the VLAN. 

The present invention also supports segregation and 
aggregation of traffic for three or more domains, based on 
the higher-level traffic type analysis. An alternative imple- 

55 mentation for closed user group services therefore might 
actually provide a third domain for such services. PPPoE 
traffic would go to the concentrator equipment 31, as dis- 
cussed above. The switch 19 would route the upstream 
transmission frames bearing a VLAN Ethertype indicator to 

60 the alternate network serving as the VLAN service domain. 
That domain would process VLAN communications essen- 
tially as done in a normal switched Ethernet type network. 
Upstream transmissions that bear any other type of Ether- 
type indicator would go to the vertical services network 13, 

65 as in the earlier examples. 

A feature of the switch, in accord with the invention, is 
that it prioritizes traffic for each customer to support QoS for 
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the various services as required by service level agreements 
(SLAs) between the customer and the carrier. In this regard, 
one implementation of the L3/4 ATM switch 19 performs 
queuing and tagging operations in accord with the desired 
prioritization. The switch will maintain two or more queues 
for each subscriber's permanent virtual circuit. The switch 
distinguishes the queues based on importance or priority. As 
the switch receives cell transmissions for transport over the 
virtual circuit to the customer premises, the switch will 
internally tag each cell as to its importance level and place 
each cell in the appropriate queue based on the tag. 

The tagging and prioritization may be based on traffic type 
or 'Type of Service* (ToS). Table 1 illustrates one example 
of the possible ToS levels that may be assigned to different 
communications. 
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tion device based rules) obtain access to the limited rate 
adaptive bandwidth available on any given subscriber's line. 
Also, the insertion point, switch 19, will usually sit behind 
the media conversion point (e.g., the DSLAM 17), An OC3 

s or other facility between the switch 19 and the DSLAM 17 
also could become congested. Preferably, the switch 19 or 
other element at the insertion point queues the traffic in such 
a manner that no downstream facility (OC3) limitations 
(which are independent of the rate adaptive DSL loop 

10 limitations) will result in packets being dropped. 

The queuing will be done based on customer and network 
provider determined rules so that contention for the facilities 
facing the subscriber will be addressed via the dropping of 
the appropriate packets. That way an inserted video stream 
doesn't overwhelm a PPPoE or Voice stream (due to facility 
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The access switch 19 will examine the content of each 
communication and determine an appropriate ToS level, for 4Q 
example in accord with the table above. Based on the ToS 
level, the switch will add a tag to the cell(s) as part of its 
internal processing. Using the ToS tags, the switch will place 
each of the cells for a given subscriber into a corresponding 
one of a plurality of queues that the switch maintains for the 45 
subscriber's traffic. 

The switch may implement any one of a number of 
different queue servicing algorithms to select and transmit 
cells from the various queues. For example, the switch 19 
may implement one of several statistical algorithms, equal 50 
queuing, weighted queuing, priority selection from queues, 
etc. The particular algorithm is selected to implement QoS 
in conformance with the subscriber's service level agree- 
ments (SLAs) with the carrier. In most cases, particularly for 
service applications from the vertical services domain, the 55 
switch 19 will not normally drop any cells or packets. In the 
rare event that the switch 19 becomes congested, any 
dropping of cells is based on the priority level assigned to 
the frame, i.e., lowest priority first. Also, if the switch ever 
drops cells, it drops all cells for an effected lowest priority 6 q 
frame from the relevant queue. 

The ability to prioritize traffic across the inserted streams 
and the PPPoE stream enables the operator to control flows 
through the ADN 10 so that the local access facility is not 
overwhelmed with content which exceeds its physical (rate 65 
adaptive) limitations. For example, the queuing rules pref- 
erably ensure that the 'proper' applications (based on inser- 



limitations). Among others, appropriate industry understood 
methods for accomplishing this queuing control include 
Weighted Fair Queuing (WFQ), Priority (PQ) Queuing, and 
Weighted Random Early Discard (WRED). 

Also, the ability of the switch 19 to examine higher level 
information provides other advantages in network opera- 
tions. For example, the switch can implement sophisticated 
filters on the higher level information, e.g., to provide 
security. As another example, the switch preferably performs 
measuring and monitoring to determine what if any packets 
get dropped (based on the physical rate adaptive 
limitations), and generates appropriate reports to an external 
operations system (not shown). 

The introduction of the L3/4 ATM switch 19 in proximity 
to the DSLAM (s) 17 also provides benefits in terms of 
operation of the gateway router 29. Due to the end-to-end 
use of the Unspecified Bit Rate (UBR) PVCs, the gateway 
router interface to the cell relay network 30 has been 
engineered to support a maximum of 2000-4000 PVCs (end 
users). This is essentially an over-provisioning of bandwidth 
that probabilistically avoids service degradation that could 
result from simultaneous demand for bandwidth. The ability 
of the L3/4 ATM switch 19 to perform QoS and rate shaping 
essentially reduces or ever removes this concern, because it 
significantly reduces the risk that the gateway router 29 will 
become a bottleneck. As a result, the ADN 10 can increase 
bandwidth efficiencies for this interface. Further, the capac- 
ity through the gateway router 29 need not be upgraded as 
often to support demand for increased bandwidth associated 
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with new bandwidth-intensive services, since many such 
services are now introduced through the vertical services 
domain 13 and the L3/4 ATM switch 19. 

To fully understand an exemplary implementation of the 
various inventive concepts, it may be helpful to consider an 
ATM-based embodiment of the L3/4 switch 19. FIG. 4 is a 
block diagram of the elements and functions of such a 
preferred embodiment of the switch 19. 

The preferred embodiments utilize Ethernet framing. As 
shown in the drawing, the switch 19 includes an Ethernet 
interface 41, an ATM interface 42 and an associated physical 
interface 43 facing toward the subscribers. In an embodi- 
ment for use in the network of FIGS. 1 and 2, the physical 
interface might take the form of one or more OC-3 or OC-12 
links to the DSLAMs 17. These links carry all ATM cell 
traffic going to and from the DSLAMs and hence to and 
from the customer equipment served through the particular 
switch 19. 

The switch 19 also includes an Ethernet interface 44. an 
ATM interface 45 and associated physical interface 46 
facing toward the gateway router 29 and hence the ISPs 11. 
The physical interface 46 might take the form of one or more 
OC-12 or OC-48 links to the gateway router 29. These links 
carry all ATM cell traffic going to and from the ISPs or other 
wide area inter-networks 11. For these communications, the 
Ethernet interface 44 passes through PPPoE traffic, as speci- 
fied by the Ethertype indicator in the cells transporting the 
relevant frame segments. 

Facing the vertical services domain, the switch 19 
includes an Ethernet interface 47 and a physical interface 48. 
These interfaces conform to the particular network utilized 
by the carrier for the vertical services domain, such as 
giga-bit Ethernet over wire or optical links. 

The switch fabric 49 performs the physical switching of 35 
data along various paths through the switch 19, in response 
to instructions from a programmed routing controller 50. 
FIG. 4 also shows the communications flow through the 
switch, for each subscriber. The switch 19 also implements 
a Decision Point 51, shown for example within the Ethernet 
interface processing 41 on the subscriber facing side. At that 
point, the PPPoE traffic is separated from all other traffic. 
From that point, the PPPoE Flow 52 for each subscriber 
extends as a portion of the subscriber's ATM virtual circuit, 
facing the cell relay network and hence the ISPs 11. The 
PPPoE Flow 52 contains Ethernet frames that are of PPPoE 
Ethertype. Facing towards the subscriber premises, the 
switch 19 implements an Aggregate Flow path 53, in the 
form of another portion of the ATM virtual circuit, which 
contains all ingress/egress subscriber traffic. The switch 
implements a Generic Path 54 extending through the inter- 
faces to the vertical services network. This path 54 carries all 
traffic other than PPPoE. 

In this example, the switch 19 implements the Decision 
Point 51 based on recognition of the Ethertype indicator, 
which is above the layer-2 ATM cell routing information. 
However, the switch may implement the Decision Point 51 
based on still higher-level protocol information. 

In a preferred embodiment, the Ethernet and ATM inter- 
faces 41 and 42 and the Ethernet and ATM interfaces 44 and 
45 implement segmentation and reassemble (SAR) 
functions, essentially providing two-way conversions 
between ATM cell format and Ethernet frame format. Seg- 
mentation involves dividing an Ethernet frame into a num- 
ber of 48-byte blocks and adding ATM headers to the blocks 
to form a corresponding number of ATM cells. Any blocks 
that do not include a complete 48-byte payload are padded 



40 



45 



50 



55 
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as necessary. Reassembly entails receiving and buffering 
ATM cells until it is recognized that a complete frame has 
been received. The ATM headers of the cells and any 
padding arc stripped, and the payload data is reassembled 
into the form of an Ethernet frame. 

In such an embodiment of the switch 19, the decision 
point 51 determines how to selectively forward the Ethernet 
frame information taken from a particular series of upstream 
ATM cells based on the Ethernet information taken from the 
ATM cell payloads, for example, by examining the frame 
header and recognizing the particular Ethertype indicator. 
Internally, the actual switch fabric 49 for such an embodi- 
ment of the switch 19 would comprise an Ethernet switch, 
even though to other elements of the ADN network 10 the 
switch 19 appears to perform an ATM switching function. 

Those skilled in the art will recognize however, that the 
decision and switch fabric may be implemented in other 
ways. For example, a series of cells corresponding to an 
Ethernet frame could be buffered and the payloads examined 
just to recognize and identify the Ethertype indicator, with- 
out a complete reassemble of the Ethernet frame. This later 
implementation therefore could utilize an ATM cell-based 
switch fabric. 

From the discussion above, it should already be apparent 
that certain aspects of the invention relate to setting up 
logical communication circuits at a relatively low protocol 
layer corresponding to switching or routing functions and 
then segregating traffic by distinguishing communication 
type using higher level protocol information. To insure full 
understanding on these points, it may be helpful to consider 
the protocol layer definitions, with particular reference to the 
illustration of the preferred layers in FIG. 2. The Interna- 
tional Standards Organization (ISO) Open Systems Inter- 
connection (OSI) reference model specifies a hierarchy of 
protocol layers and defines the function of each layer in the 
network. 

The lowest layer defined by the OSI model is the physical 
layer (LI). This layer provides transmission of raw data bits 
over the physical communication channel through the par- 
ticular network. For example, on the subscriber lines in the 
preferred embodiment, the physical layer (LI) uses ADSL. 
Within the customer premises, communications use an Eth- 
ernet physical layer (LI), such as lOBase-T Upstream 
network elements may use DS3 at some points, but most use 
SONET, for example OC-3 or OC-12 physical layer trans- 
port. Attention is directed to the lower half of the diagram in 
FIG. 2, which depicts the various protocol stacks throughout 
the network 10. 

The layer defined by the OSI model next to the physical 
layer is the data link layer (L2), The data link layer trans- 
forms the physical layer, which interfaces directly with the 
channel medium, into a communication link that appears 
error-free to the next layer above, known as the network 
layer (L3). The data link layer performs such functions as 
structuring data into packets or frames, and attaching control 
information to the packets or frames, such as checksums for 
error detection, and packet numbers. In the network 10, the 
data link layer (L2) is used to define certain switching 
functions through the network. The network layer (L3) 
provides capabilities required to control connections 
between end systems through the network, e.g., set-up and 
tear-down of connections. 

The preferred embodiments utilize ATM cell transport as 
the lowest element of the data link layer (L2), for example 
to define the connectivity extending from the ATU-Rs 23 
through the ADN network 10 to the ISP or corporate 
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networks 11. Subscriber virtual circuits are provisioned at 
the ATM cell layer, that is to say at the data link layer (L2). 
Similarly ISP virtual circuits are provisioned at this ATM 
data link layer (L2), from the gateway router 29 through the 
cell relay network 30 to the ISP access concentrators 31. The 5 
ATM protocol therefore is the layer-2 (L2) protocol used to 
define the logical connectivity from the subscriber premises 
to the gateway router 29. The ATM protocol also is the 
layer-2 (L2) protocol used to define the logical connectivity 
from the gateway router 29 to the ISP concentrators 31. 1Q 

For purposes of this discussion, higher level protocols are 
protocols that ride on or are encapsulated within the par- 
ticular layer-2 protocol, that is to say in the payloads of the 
ATM cells in the preferred embodiment. Such higher level 
protocols include some protocols, which are often consid- 15 
ered themselves to be level-2 protocols, where they are 
transported within ATM cells. The preferred embodiments 
use Ethernet, a local area network protocol above the ATM 
portion, of the L2 layer. Technically, the Ethernet protocol 
may be considered as another L2 layer protocol. However, 20 
because it is segmented and encapsulated into the payloads 
of the ATM cells, the Ethernet protocol information actually 
is a higher level protocol information above the specific 
level-2 protocol (ATM) that defines the normal connectivity 
through the ADN network 10. ^ 

In the OSI model, a transport layer protocol (L4) runs 
above the network layer. The transport layer provides con- 
trol of data transfer between end systems. Above the trans- 
port layer, a session layer (L5) is responsible for establishing 
and managing communication between presentation entities. 30 
For example, the session layer determines which entity 
communicates at a given time and establishes any necessary 
synchronization between the entities. Above the session 
layer, a presentation layer (L6) serves to represent informa- 
tion transferred between applications in a manner that pre- 35 
serves its meaning (semantics) while resolving differences in 
the actual representation (syntax). A protocol (L7) that is 
specific to the actual application that utilizes the information 
communicated runs at the top of the protocol stack. 

In accord with one inventive concept the network 10 40 
actually utilizes two or more different types of protocol at 
levels above the protocol within the L2 layer that actually 
defines the network connectivity. The ADN network 10 may 
use different protocols at the higher layers as well. By 
distinguishing transmissions based on differences in these 45 
higher-level protocol types, the ATM switch 19 separately 
forwards different types of communication traffic for each 
subscriber. In the preferred embodiment, communications to 
and from the ISP or corporate networks 11 utilize point-to- 
point protocol (PPP) as the network layer (L3) protocol and 50 
a shim for transport of PPP over Ethernet (PPPoE). PPPoE, 
as one Ethertype protocol could also be considered as a 
second layer (L2) protocol albeit above the Ethernet layer 
itself, which in turn rides on the ATM cells used for routing 
at least through the permanent virtual circuit at the L2 layer. 55 

In the illustrated implementation, however, the use of the 
PPPoE or a different protocol actually is an indication of a 
difference in type of the higher layer protocols. In the 
illustrated example of FIG. 2, the vertical services domain 
traffic utilizes Ethernet (802.3 SNAP) above the ATM adap- 60 
tation layer (AAL). As noted, the presently preferred L3/4 
switch 19 implements its routing decision based on recog- 
nition of the Ethertype indicator, that is to say to distinguish 
the PPPoE traffic from all other types of transmission from 
the customers' data equipment. In view of the use of ATM 65 
as the data link layer (L2) protocol of the network defining 
the lowest layer of network connectivity for communica- 
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tions services through the ADN network 10, the discrimi- 
nation based on Ethernet actually implements a decision 
based on an effectively higher protocol layer. 

IP protocol carries the actual higher- level applications 
information, for transport to and from the vertical services 
domain and for transport to and from the wide area inter- 
network. As such, IP and its related transport protocol 
referred to as the "Transmission Control Protocol" (TCP) 
ride on top of (are actually encapsulated within) the lower 
level protocol elements discussed above. Presentation and 
application layer elements ride on top of the IP layer. IP 
communication requires that each user device have an 
assigned IP address. IP addresses, however, are a scarce 
commodity. Because of the use of IP transport for both wide 
area services and vertical domain services, the network 10 
actually may at times assign two different IP addresses to 
each active data communication device of an end-user, albeit 
on a temporary basis. The wide area communications and 
the vertical services network may also be viewed as two 
separate 'broadcast' domains. 

First, the carrier operating the ADSL data network 10 and 
the vertical services domain network 13 will maintain a pool 
of local addresses for assignment, on an as-needed basis, to 
end user equipment 25. To the carrier, the available IP 
addresses are a limited resource. Accordingly, the carrier 
assigns IP addresses on a dynamic basis, only to those users 
actually on-line at any given time. The carrier preferably 
utilizes private network type IP addresses and dynamically 
administers such addresses using dynamic host configura- 
tion protocol (DHCP). DHCP is a protocol for automatic 
TCP/IP configuration, which enables dynamic address allo- 
cation and management. 

When a particular device 25 becomes active via the 
ATU-R 23 and the DSLAM 17, it will activate a basic 
protocol stack, including an IP portion enabling communi- 
cation with a DHCP server. The device will transmit an 
address request upstream through the network on the sub- 
scriber's virtual circuit. At the Ethernet level, this transmis- 
sion appears as a broadcast message. The L3/4 ATM switch 
19, however, will recognize that the packet is not a PPPoE 
communication and route the cells carrying the packet into 
the vertical services domain 13. Typically, a DHCP server is 
coupled to the vertical services domain network 13, for 
example as part of the carrier's administrative network or 
systems 33. The DHCP server somewhere on the vertical 
services domain 13, 33 will answer that broadcast request by 
selecting and providing an available one of the private IP 
addresses from the carrier's pool of available addresses. The 
message with the assigned address will go back to the L3/4 
ATM switch 19 for insertion into the virtual circuit and 
transport back to the requesting device 25. ■ 

The particular end-user's device 25 uses the assigned 
private IP address as its source address, for all of its 
communications with the vertical services network 13, so 
long as it remains on-line for the present session. When the 
overall session ends and the end-user device 25 goes com- 
pletely off-line, the DHCP server returns the private IP 
address to its pool of available addresses, for reassignment 
to another user as the next user comes on-line. 

As noted, the user equipment 25 receives a private IP 
address from the DHCP server. The addresses of services on 
the vertical services domain also are private IP networks. 
Because these addresses are private, they are accessible only 
to equipment within that domain and the data network 10. 
Consequently, the devices are not accessible to hackers or 
the like coming in through the public Internet. 
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This dynamic assignment of IP addresses allows the address request. The switch 19 also limits transport of 

carrier to limit the number of IP addresses used to the non-PPPoE broadcast messages to the vertical services 

number of users actively connected through the ISP's host to domain network 131, both for the address request message 

the Internet. The use of private IP addresses allows the user and for other types of broadcast requests. As such, the 

equipment to communicate with the vertical services domain 5 logical circuit to the PPPoE concentrator 31 becomes the 

utilizing a normal IP-Ethernet protocol stack. conduit to one broadcast domain for upstream PPPoE mes- 

For the as-desired Internet access service, for example sages; and the vertical services network 13 defines a second 

using a PPP or similar protocol, IP addresses are adminis- broadcast domain for upstream messages of other Ether- 

tered through the ISPs. The PPPoE protocol preserves or 10 types, 
emulates the traditional dial-up approach to ISP access. 

However, the PPPoE approach does utilize Ethernet and In addition 10 vertical services > me carner °° ntinues to 

follows Ethernet standards, for example, involving process- P rovide a S reed access s*™** to equipment of the ISPs, 

ing of certain broadcast messages. in a manner analogous to current practices. For example, the 

t, . . rcn f , . . . , t 15 carrier may provide its Internet access service to a subscriber 

The user can select an ISP of choice, and her data 7 * 

equipment 25 will initiate a selective session through the 0Q a monthl y subscription basis, at one of several available 

Ethernet layer on the network 10 to access the equipment 31 rates corresponding to the grade of Internet access service 

of the selected ISP network 11, in a manner directly analo- ( and thus the rale of communication to/from the ISP) 

gous to a dial-up modem call through an ordinary telephone 20 selected by the customer's subscription, 

network. Hence at a time after initial activation through the In an en h ance d service offering, the broadcast provider 

networks 10 and 13, the user may activate a browser or other CQuld offef a convenienl navigation interface from a web 

program for using the wide area internetwork service. This seryer ^ ^ m be 0fl ^ vertical ser vices network, 

activates a second protocol stack, which includes, the PPP ^ ^ preferably fc 0D me wide area Internet U . with a PPPoE 

protocol and the PPPoE shim. The user selects an ISP, and ^ ^ ^ can surf tQ ^ providcr > s xrvet and 

the data equipment initiates communication through the . .... . ™ 

_ ? h , „ . . . view information about available programming. The user 

network 10 to the PPPoE equipment 31 of that ISP. . K < r v • 

n r might select a current broadcast program by 'clicking on a 

The IP addresses used by each ISP are public network URL link in the provider's web-based information. Although 
type IP addresses. To the ISP, the pool of available public IP 30 ^ ^ ^ ^ ^ ^ URL 
addresses also is a limited resource. Accordingly, each ISP ^ ^ e Jp for ^ desire(J 
prefers to assign IP addresses on a dynamic bas*, only to m ^ ^ vertical ^ 
those users actually on-line at any given time. Typically, as ^ ^ rf ^ a ^ gem 
part of each initial access operation for a PPPoE session, the 35 ^ m {q ^ ^ ^ m m6 yertical aHvices 
user's equipment 25 and the PPP terminating equipment 31 u (q ^ ^ tQ 
of the ISP conduct a handshaking, to establish data corn- ^ ^ ^ to ^ broadcast A similar 
munitions therebetween. As part of this operation, the me(hodol mi m ^ enable a provider t0 offer meml> 
user's device transmits a broadcast request for . public IP ^ order/billin wenixs from the ]nternet U> , 0 
network. The broadcast message, in PPPoE goes through the 40 e jew Qr video on . demand type 
virtual circuit to the gateway router 29 and through the ^ ^ vertica] domain network ^ 
router and cell relay network 30 to the ISPs PPPoE equip- 
ment 31. Although it is a broadcast message, the network Although IP-based, the services from the vertical services 
effectively limits transport thereof to the virtual circuit going ^ domain 13 may follow any other desirable business model, 
to the ISPs PPPoE equipment 31, that is to a domain separate For example, a multicast service provider may contract with 
from the vertical services network domain 13. the carrier to provide multicast audio (radio-like) and/or 

The ISP host equipment 31 initiates a procedure to assign video (TV-like) services via the vertical services domain. 

the user's computer 25 a numeric Internet Protocol (IP) The multicast service provider, not the subscribers, would 

address from the pool of available public addresses and 50 pay the carrier. The multicast service provider may offer any 

sends a PPPoE message containing that address back to the or all of the multicast programming to customers on some 

subscriber's device 25. When the session ends and the user type pay-per-view basis but would likely offer most of the 

goes off-line, the ISP host can reassign the address to another programming service for free or bundled in as part of some 

user, as the next user comes on-line. nominal monthly subscription charge. The multicast service 

. t fin „ *u icd provider instead would charge advertisers in a manner 

This dynamic assignment of IP addresses allows the ISP ? & 

. , , * m j .u analogous to current broadcast business practices. Ad vertis- 

to limit the number of public IP addresses used to the . in w *• u u 

... r 4 , t , T ™ . ing distributed with the IP multicasting, however, can be 

number of users actively connected through the ISP s host to* t „ 4 ,j « j * u* a 

, ™ . 4-ii'i * carefully targeted at end -customers having demographic 

the Internet. The end-user equipment will implement a 7 . . . . c . , . . ?. - A . 

... . . 60 profi es meeting specific criteria specified by individual 

second protocol stack, carrying PPPoE communications. ou * , . , - . 4 . l4 . t . . 

_ 4 ' J * « . . . advertisers, which allows the multicast service provider to 

The PPP protocol will allow the end-user equipment to .... 

obtain and utilize the public IP address for communications c ar ^ e P rencuum a ve lsin S ra es - 

going to and from the public internetwork. Table 2 summarizes the characteristics and requirements 
The switch 19 will limit transport of other types of PPPoE es of a number of examples of the types of vertical services that 
broadcast messages to the link to the PPPoE concentrator 31, the VSD network 13 can deliver via the L3/4 ATM switch 19 
in a manner similar to that described above for the PPPoE and the ADSL data network 10. 
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TABLE 2 



Vertical Service 
Offering 



Characteristics of the Service 



Network Requirements 



Voice Services 



Video On Demand 
(Unicast) 



Multimedia Broadcast 
(Multicast) 
Caching Services 



Distance Learning 
(EVC) 

Telecommuting 



Local Co-Located VoIP Gateways, VoIP, 
Unified messaging, IP PBX, IP Centrex 

Local VOD Servers or access to centralized 
servers. 

Supports whatever model of server 
deployment/content delivery mechanism 
Broadcast Video; Broadcast Audio; Satellite 
Down Link support; Local Servers at the edge. 
Local servers at the insertion point, Local 
delivery mechanism for generic media objects 
such as web pages, images, video files, audio 
clips, software downloads, etc. 
Integrated interactive video, voice and data 



Closed user group with access to Transparent 
LAN Service (TLS). 



Low latency, low jitter, non- 
correlated packet loss, and high 
availability 

High bandwidth, low jitter, high 
availability, and low packet loss 



Varies with content type and with 
multicast implementation 
Layer 3/4 visibility 



Low latency, low jitter, non- 
correlated packet loss, and high 
availability 
IEEE 802.IO 



One alternative arrangement, to that of FIG. 1, for pro- 
viding DSLAM functionality is illustrated in FIG. 5. This 
arrangement locates a remote terminal DSLAM 25 
(RTDSLAM) 502 downstream from the central office (CO) 
504, typically via an OC-12 link 506. The RTDSLAM 502 
communicates with subscribers over xDSL links 510, 511 
and 512. The links 510, 511 and 512 can be any of a variety 
of DSL services such as SDSL, HDSL, VDSL and ADSL, 3Q 
similar to those provided by the central office DSLAM in the 
earlier embodiment. 

As illustrated in FIG. 5, more than one RTDSLAM 502 
and 532 can communicate with a central DSLAM 534 in the 
CO 504, with each RTDSLAM servicing a number of 35 
different subscribers. In alternate embodiments, the central 
DSLAM 534 and intermediate link 540 can be omitted such 
that the RTDSLAMs 502 and 532 interface directly with a 
switch 536 in the central office 504 via links 506 and 546. 

The downstream traffic from one or more Internet Service 40 
Providers (ISP) 555 over virtual circuits 550-553 are aggre- 
gated by the switch 536 over physical links 540 and 506 and 
are forwarded to and through the DSLAM 502. Each virtual 
circuit is typically limited to the rates denned in any SLAs 
that the carrier has with a particular customer. However, the 45 
RTDSLAM 502 can still become overburdened with traffic 
from all its associated virtual circuits even when each virtual 
circuit is within its individual limit. In such instances, the 
RTDSLAM 502 handles downstream traffic on a first come, 
first served basis resulting in some discarding of traffic for 50 
a virtual circuit that did not exceed its SLA limit. This 
method of discarding traffic effectively places all the traffic 
within, and among, the different PVCs at the same priority 
level with no guaranteed service quality relative to other 
PVC traffic arriving at the DSLAM. 55 

By allowing the different virtual circuits through the 
RTDSLAM 502 to have assignable priority levels in relation 
to each other or by allowing the different types of traffic 
within a particular virtual circuit to have assignable priority 
levels, the invention provides a structured approach to how co 
traffic is forwarded to a potentially overburdened RTD- 
SLAM. As a result, different tiers of service can be guaran- 
teed for downstream traffic through an RTDSLAM. 

FIG. 6A illustrates a detailed view of a portion of the ADN 
between the VSI switch 536 and the subscriber's equipment, 65 
in which an RTDSLAM 502 is used for connecting to the 
subscriber equipment 690, 691 and 692. 



Three permanent virtual circuits (PVCs) 602, 604 and 606 
are illustrated in FIG. 6 A, with each PVC carrying the 
communications between a subscriber and their ISP. As 
illustrated, two of the PVCs 602 and 604 connect to the same 
ISPj and may be physically carried on the same DS-3 link 
610, for example. The other PVC 606 can connect to a 
different ISP 2 also via a DS-3, or other, link 612. 

As previously described, the downstream traffic in the 
PVCs 602, 604 and 606 is switched through the VSI switch 
536 and forwarded to a central DSLAM 616. The down- 
stream ISP traffic is also combined, as needed, with data 
from the vertical services domain 620 by inserting, at the 
switch 536 any vertical services data. into the appropriate 
PVC 602, 604 and 606. From the central DSLAM 616, the 
PVCs 602 , 604 and 606 are aggregated over a high-speed 
link 506 and sent to the RTDSLAM 502. From the RTD- 
SLAM 502, each PVC 602, 604 and 606 is carried to a 
subscriber 690, 691 and 692 over an xDSL link. 

As described in relation to providing QoS for the data 
from the vertical services domain, the switch 536 includes 
multiple sets of queues 632, 634 and 636 for each PVC 602, 
604, and 636, respectively. Each set of queues 632, 634 and 
636 are shown as having four separate queues in order to 
maintain consistency with previously described queue struc- 
tures and corresponding types of service. As noted in that 
previous discussion, having four different queues is merely 
an exemplary structure and other numbers of queues can 
also be implemented. 

As previously noted, the presence of the queue sets 632, 
634 and 636 provides a way to prioritize downstream traffic 
within a PVC arriving at the switch 536 from the vertical 
services domain 620. In addition, these queue sets 632, 634 
and 636 can be used to provide a method of prioritizing 
downstream traffic within a PVC arriving at the switch 536 
from an ISP. 

A subscriber, for example 690, may want to ensure his 
downstream traffic has a relatively higher priority than other 
subscribers 1 downstream traffic that is also passing through 
the RTDSLAM 502. Alternatively, or in conjunction, the 
subscriber 690 may be a business that places more impor- 
tance on data services from the ISP than video services from 
the ISP, or from the vertical services domain 620, and may, 
therefore, want to prioritize data traffic accordingly. Other 
subscribers can have different priorities in relation to the 
various voice, data, and video services being delivered from 
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their ISPs and the vertical services domain. By controlling A preferred method for servicing the ingress queues, is to 

the manner in which downstream data from the ISP within utilize access control lists (ACLs) that depend on a specified 

a particular PVC, and among different PVCs, is queued in tier of service for a PVC in relation to other PVCs passing 

the switch 536, different grades of service, or tiers of quality, through the same RTDSLAM. An ACL is considered to be 

can be offered to subscribers. 5 a rule-set that describes how queue entries from a particular 

Similar to the prioritizing of vertical services data into PVCs ingress queue set (for example 632) are forwarded to 

Control/High/Medium/low queues, as described earlier in the egress queue 652. An exemplary ACL, therefore, would 

relation to Table 1, downstream traffic in a PVC 602 from an identify those PVCs 602, 604 and 606 that utilize the same 

ISP can be prioritized into the different queues according to RTDSLAM 502 and a relative level of quality associated 

agreed upon service levels associated with different types of 1Q with each of those PVCs and/or the specific services within 

traffic coming from the ISP. Preferably, the prioritization is the PVCs. In one embodiment, using predetermined knowl- 

based on information from protocol layers above the layer 2 edge regarding the likely capacity of the RTDSLAM 502, 

protocol defining the switched connectivity through the the switch 536 would service each of the ingress queue sets 

network (e.g., in this embodiment, above the ATM cell 632, 634 and 636 based on the relative priorities as indicated 

layer). Based on the type of traffic in particular cells or by the ACLj m or d cr to populate the egress queue 652. As 

frames within PVC 602 and an agreed upon prioritization a result of this two . t i er queue structure, prioritization of 

rule-set for that subscriber 690, downstream ISP traffic downst ream traffic can be accomplished not only within a 

within the PVC 602 is appropriately distributed among the pvc bu( ^ between different PVCs. 

four queues 632. In normal operation, a complete respective . . . 

frame containing data from all the cells transporting that , ™ e rate of servicing the egress queue 652 can be regu- 

frame, is placed in the appropriate ingress queue as it is 20 lated so as to limn^e downstream traffic to a capacity that 

received, and the switch reads data from the ingress queue * downstream RTDSLAM can handle. Withm the RTD- 

to move the frame (i.e., all the corresponding cells) to the SLAM there are buffers which handle one or more PVCs 

appropriate egress queue. going t0 one or more CPE devices - ™ e swltch 536 15 able 

However, unlike the typical Ethernet traffic received from to automatically determine, or is programmed with 1 infer- 
tile vertical services domain 620, the traffic arriving at the 25 nation relating to, a buffer size associated with each PVC m 
switch 536 from an ISP is typically ATM cells which the the RTDSLAM. The servicing algorithms for the ingress 
switch 536 re-assembles into Ethernet frames. As ATM cells, queues 632, 634 and 636 and egress queues 652 are per- 
the traffic type (e.g., video, data, voice etc.) of the arriving formed by the switch 536 so as not to exceed the buffer 
traffic is difficult to determine and, therefore, makes priori- capacity of a buffer in the RTDSLAM. By limiting the traffic 
tizing the traffic based on traffic type just as difficult. 30 in this manner the number of cells dropped by the RTD- 
Accordingly, the switch 536 can re-assemble the arriving SLAM can be reduced. A greater benefit, however, is that if 
cells into higher-level frames and packets, for example layer cells need to be dropped, then the selection of dropped cells 
3 or layer 4 packets, so that the traffic type can be easily can effectively be performed at the switch based on relative 
identified and prioritization of the cells into the different priority of the cells. Furthermore, because the switch can 
queues can be accomplished at the frame level. This 35 view data in the context of frames, as opposed to just cells, 
re-assembly into higher level frames can be semi-permanent reduction in the number of cells passing through an RTD- 
so that the frame is switched through the switch fabric of the SLAM can be accomplished by the switch dropping a single 
switch 536 as the higher level frame and then disassembled frame of multiple cells rather than the RTDSLAM randomly 
into ATM cells before being transmitted from the switch's dropping a cell from a number of different frames. Random 
downstream side. Alternatively, this re-assembly could be 40 cell loss randomizes the impact on larger, multi-cell frames, 
temporary and only to the extent needed to identify the Dropping even a single cell from a frame typically results in 
appropriate upper-layer information; and the switch 536, loss and retransmission of the whole frame; accordingly, 
therefore, would be configured to queue and switch ATM even though downstream traffic may be limited (i.e., shaped) 
cells through its fabric. by the switch in the present invention, the actual throughput 

As just described, the downstream ISP traffic within a 45 through the RTDSLAM is improved by reducing the random 

particular PVC can be examined at a higher protocol level nature in which cells are dropped and frames retransmitted 

and prioritized based on a queuing strategy in accordance at the RTDSLAM. 

with a selected grade of service for different traffic types FIG. 6B illustrates a modified version of the logical view 
within that PVC. However, the queues 632, 634 and 636 do of the VSI switch 19 depicted in FIG, 4. In FIG. 6B, two of 
not accomplish prioritizing traffic among different PVCs. 50 the many possible PVCs 720 and 722 through the switch are 
A queuing structure with two tiers can be used to provide logically depicted as well as the functional elements for 
prioritization between the different PVCs 602, 604 and 606. processing those PVCs. In addition to the elements of the 
The first tier comprises the queue sets 632, 634 and 636 for switch 19 already described in relation to FIG. 4, each PVC 
the individual subscriber PVCs. The second tier comprises a 720 and 722 has an ingress queue set 702. The switch 19 also 
queue set 652 of prioritized queues for the link from the 55 maintains an egress queue 704 populated from the individual 
switch 536 to the RTDSLAM 502. The second tier queue ingress queues 702. The remaining elements illustrated m 
652 receives cells from the individual PVC queues 632, 634 FIG. 6B are identical in name and function to those 
and 636. In a preferred embodiment, the queue 652 also has described in relation to FIG. 4 and, therefore, a redundant 
a four-queue structure that is serviced according to any of description of these elements will be avoided, 
the many conventional methods, as described earlier, based 60 In each PVC flow 720 and 722 through the switch 19, a 
on the capacity of the downstream facility. For ease of set of ingress queues 702 is provided that prioritizes down- 
reference, the queues 632, 634 and 636 can be referred to as stream data according to a level of service rule-set applied 
ingress queues and the queue 652 can be referred to as the to the downstream traffic when examined at a layer above 
egress queue. The prioritization of traffic between the dif- the ATM layer. Both the downstream traffic from the vertical 
ferent PVCs 602, 604 and 606 is accomplished according to 65 services domain and the downstream traffic from the ISP 
how the ingress queues 632, 634, and 636 are serviced in domain can be queued in the egress queue set 704 according 
order to populate the egress queue 652. to a predetermined SLA. The downstream ATM traffic 



03/13/2004, EAST Version: 1.4.1 



US 6,424,< 

29 

generated from each of the ingress queues 702 of the 
different PVCs is then prioritized into egress queue 704 
according to an ACL that controls the servicing of the 
ingress queues 702 by specifying relative priorities of the 
different PVCs 720 and 722 that are destined for the same 5 
RTDSLAM. Accordingly the modified switch of FIG. 7B 
and its two-tier queuing structure allows prioritization of 
down stream traffic within each PVC 720 and 722, for 
example, and among the different PVCs being switched 
through the switch 19. 1Q 

While the foregoing has described what are considered to 
be the best mode and/or other preferred embodiments of the 
invention, it is understood that various modifications may be 
made therein and that the invention may be implemented in 
various forms and embodiments, and that it may be applied 
in numerous applications, only some of which have been 15 
described herein. It is intended by the following claims to 
claim any and all modifications and variations that fall 
within the true scope of the inventive concepts. 

What is claimed is: 

1. A method for queuing downstream traffic in a data 
communications network in order to prioritize the down- 
stream traffic according to tiers of service, comprising the 
steps of: 

receiving a plurality of frames destined for subscriber 
equipment, each of said plurality of received frames 
associated with one of a plurality of logical communi- 
cations pipes, and each of said plurality of logical 
communications pipes having an associated level of 
quality and an associated set of ingress queues; 3Q 

queuing each one of the plurality of received frames, 
based on information within that one frame, in a 
particular queue within the set of ingress queues that 
correspond to the logical communications pipe associ- 
ated with that one frame, wherein each queue within 35 
each of the sets of ingress queues has a first associated 
priority level; 

servicing the plurality of sets of ingress queues based on 
at least one of the first associated priority levels of each 
queue within each of the plurality of sets of ingress 40 
queues and the level of quality associated with each of 
the sets of ingress queues, to populate a set of egress 
queues, each queue within the set of egress queues 
having a second associated priority level; and 

servicing each queue of the set of egress queues based on 45 
the second associated priority level of each queue, to 
provide downstream traffic prioritized into different 
tiers of service. 

2. The method according to claim 1, further comprising 
the step of: so 

determining data within each of the plurality of received 
frames relating to a network protocol layer above the 
data-link layer and wherein the queuing of each 
received frame is based on the determined data for that 
frame. 55 

3. The method according to claim 2, wherein the deter- 
mined data identifies a type of service associated with each 
of the plurality of received frames. 

4. The method according to claim 1, wherein the servicing 

of the plurality of sets of ingress queues is based on a 60 
temporary storage capacity, in one or more downstream 
facilities, associated with each of the logical communica- 
tions pipes. 

5. A method for queuing downstream traffic destined for 

a remote terminal DSLAM, comprising the steps of; 65 
receiving a plurality of frames, each frame associated with 
one of a plurality of virtual circuits, each of said 
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plurality of virtual circuits having a corresponding level 
of service and a corresponding set of ingress queues 
wherein each of said plurality of received frames is 
thereby associated with a set of ingress queues; 
based on data within each of the plurality of received 
frames, placing each of the plurality of received frames 
in a particular one of the queues within the set of 
ingress queues that correspond to the virtual circuit 
associated with that frame, each of queues within each 
of the sets of ingress queues having a corresponding 
priority level; 

servicing the plurality of sets of ingress queues based on 
at least one of the associated priority levels of the 
queues within each of the sets of ingress queues and the 
corresponding level of service of each of the sets of 
ingress queues, to populate a set of egress queues with 
the plurality of received frames, each of the queues 
within the set of egress queues having an associated 
priority level; and 
servicing the set of egress queues according to the cor- 
responding priority levels of the queues within the set 
of egress queues to generate traffic destined for the 
remote terminal DSLAM. 

6. The method according to claim 5, wherein the data 
within each of the received plurality of frames relates to one 
of network-layer and transport-layer information. 

7. The method according to claim 5, wherein the data 
within each of the received plurality of frames relates to a 
type of service associated with that frame. 

8. The method according to claim 7, wherein the type of 
service is one of video service, data service and voice 
service. 

9. The method according to claim 5, wherein each of the 
received plurality of frames is received from one of an 
internet services domain and a vertical services domain. 

10. The method according to claim 5, wherein the ser- 
vicing of the plurality of sets of ingress queues is based on 
a data buffering capacity, in the remote terminal DSLAM, 
associated with each of the virtual circuits. 

11. A data switch for use in a communications network, 
comprising: 

a first interface, for communication with a first network 
domain via a plurality of virtual circuits, each virtual 
circuit having a corresponding level of service; 
a second interface, for data communication to and from 
data equipment at a plurality of customer premises via 
the plurality of virtual circuits; 
a switch fabric coupled to the interfaces and configured to 
forward downstream data from the first interface to the 
second interface according to the plurality of virtual 
circuits; 

a plurality of sets of first-tier queues coupled with the first 
interface, each of said sets of first-tier queues associ- 
ated with one of the plurality of virtual circuits and each 
of said sets comprising a first plurality of queues, each 
of said first plurality of queues having an associated 
priority level; 

a second -tier queue set coupled with the second interface 
and comprising a second plurality of queues each of 
said second plurality of queues having an associated 
priority level; and 
a switch controller configured to: 
place each particular frame of a plurality of frames, 
associated with a corresponding one of the plurality 
of virtual circuits, received at the first interface from 
the first network domain, into a one of the first 
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plurality of queues within one set of first-tier queues 
associated with that corresponding one virtual 
circuit, based on information within each said par- 
ticular frame; 

service each of the sets of first-tier queues, to populate 
the second plurality of queues within the second -tier 
queue set, according to at least one of: 

a) the associated priority levels of the first plurality 
of queues within that set of first-tier queues, and 

b) the corresponding level of service of the virtual 
circuit associated with that set of first-tier queues; 
and 

service the second-tier queue set according to the 
associated priority levels of the second plurality of 
queues within the second-tier queue set, to generate 
traffic for transmission via the second interface. 

12. The switch according to claim 11, further comprising: 
an access control list that identifies the corresponding 

level of service for each virtual circuit. 

13. The switch according to claim 11, further comprising: 
a third interface for communication with a second net- 
work domain and coupled with the plurality of sets of 
first-tier queues; and 

wherein said switch controller is further configured to: 
insert each of a plurality of frames from the second 
network domain, received via the third interface, into 
a specific virtual circuit by placing each of the 
plurality of frames from the second network domain 
into one of the first plurality of queues within a set 
of first-tier queues associated with that specific vir- 
tual circuit, based on information within each of the 
plurality of frames from the second network domain. 

14. The switch according to claim 13, wherein the first 
network domain comprises an internet services domain and 
the second network domain comprises a vertical services 
domain. 

15. The switch according to claim U, wherein the infor- 
mation within each said particular frame relates to a network 
protocol layer above a data-link layer. 

16. The switch according to claim U, wherein the infor- 
mation within each said particular frame indicates a type of 
service associated with that particular frame. 

17. The switch according to claim 16, wherein the type of 
service is one of voice service, data service, and video 
service. 

18. In an access data network, comprising: 

a communication access node coupled to a wide area 
internetwork; 

a plurality of digital subscriber line transceivers coupled 
to network ends of subscriber lines, for data commu- 
nication with transceivers coupled to respective cus- 
tomer premises ends of respective subscriber lines; 

an access switch coupled for data communications with 
the digital subscriber line transceivers, for receiving 
data from customer premises equipment via respective 
ones of the digital subscriber line transceivers and for 
supplying data intended for transmission to predeter- 
mined customer premises equipment to the respective 
ones of the digital subscriber Une transceivers; 

a remote terminal DSLAM between the access switch and 
the plurality of digital subscriber transceivers, said 
remote terminal DSLAM including a plurality of 
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buffers, each buffer associated with one or more of the 
subscriber lines; 
a high-speed data link between the access switch and the 

communication access node; 
a local services network coupled locally to the access 
switch, wherein the access switch segregates upstream 
traffic from the respective customer premises equip- 
ment between the local services network and the high- 
speed data link to the communication access node, and 
the access switch aggregates downstream traffic from 
the local services network and the high-speed data link 
from the communication access node for transmission 
to the respective customer premises equipment, 
a method of providing different tiers of quality to the 
different subscriber lines, each different subscriber Une 
having an associated set of similar ingress queues, the 
method comprising the steps of: 
queuing the aggregated downstream traffic in each of 
the different subscriber lines into one of a plurality of 
queues within the set of ingress queues associated 
with that subscriber line, based on a type of service 
associated with the aggregated downstream traffic; 
populating a set of egress queues with the aggregated 
downstream traffic from all of the different sub- 
scriber lines by servicing the different sets of ingress 
queues according to at least one of a priority level 
associated with each of the plurality of queues within 
the different sets of ingress queues and a level of 
quality associated with each of the different sets of 
ingress queues; and 
servicing the set of egress queues according to a 
priority level associated with each of the queues 
within the set of egress queues to generate down- 
stream traffic through the RTDSLAM having differ- 
ent tiers of quality. 

19. The method according to claim 18, wherein: 
services are provided through the access data network to 

customer premises equipment of each customer via a 
logical circuit provisioned through the access data 
network, the logical circuit extending from the cus- 
tomer premises equipment of each customer to the 
communication access node via the access switch and 
the high-speed data link, and 
the logical circuit comprises a layer-2 protocol logical 
communication circuit provisioned through the access 
switch and the high-speed data link. 

20. The method according to claim 19, wherein the 
layer-2 protocol logical communication circuit comprises an 
Asynchronous Transfer Mode (ATM) virtual circuit. 

21. The method according to claim 19, wherein the logical 
circuit has a corresponding level of quality. 

22. The method according to claim 18, further comprising 
the steps of: 

determining a data capacity of each of the plurality of 
buffers; and 

servicing each of the different sets of ingress queues 
according to the determined data capacity of the buffer 
associated with the subscriber line corresponding to 
that set of ingress queues. 
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